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SUPRiARY 

A  simple  procedure  is  given  to  calculate 
the  optimal  strategies  and  the  survival  prob¬ 
ability  for  a  general  class  of  games  of  survival. 

Theorem  1  show s  that  for  games  of  this  particular 
type ,  the  optimal  strategy  for  both  players  de¬ 
pends  only  on  the  amount  of  money  held  by  the 
SGeond  ola  ypf  * 

OPTIMAL  STRATEGIES  IN  GAMES  OF  SURVIVAL 

Melvin  Hausner 

In  RM-7’76,  the  author  considered  games  of  the  following 
type.  Players  I  and  II  play  a  zero-sum,  2x2  game  con¬ 
tinually,  play  ceasing  when  one  of  the  players  runs  out  of 
money.  If  the  payoff  matrix  to  I  is 

11  a  1  2.\ 

j.  =(  >  3 n  >  0;  ai2>  a2 1  <  o» 

V  2  1  a2  zj 

then  the  above  game  was  shown  to  have  a  solution.  The  play  for 
I's  survival  and  II’ s  ruin  are  equivalent  for  player  I.  Player 
I  can  assume  himself  a  probability  v  (k)  of  survival  (n  is 
the  amount  of  money  in  the  game,  k  is  I’s  initial  share  of 
the  money)  if  he  plays  optimally,  while  II  can  limit  him  to 
this  orobability  of  survival. 

The  difficulty,  in  practice,  lies  in  the  calculation  of 
v  ( k )  .  (The  optimal  mixed  strategies  are  simple  functions  of 
v  (k).)  We  give  a  case  where  some  general  statements  may  be 
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ma.de  about  the  solution  and  where  the  computation  is  greatly 
shortened.  Vie  shall  always  assume  that  n,  k,  and  are 

integers. 

Lemma  1 :  Suppose  that  I  cannot  lose  more  than  1  unit 
of  money;  i.e.  the  payoff  matrix  is  of  the  form 

(D 

then , 


a 

-1 


-1 

b 


b  >  0. 


(2)  vn+1ik+1!  =  vn(k) 

Proof:  Let  II  olay 

following  strategy  of  I's: 
olays  his  opt  imp  1  s t rn t e gy 


1-vn(k) 


vn+1  11 K 


his  optimal  strategy  against  the 
I  reserves  one  unit  of  money  an 
for  the  reduced  game,  where  his 


d 


calculate  I's  probability  of  survival  if  both  players  play 


slavers  strategy  provided  one  of  the  players  uses  his  optimal 
strategy.  Assume  that  I  has  k+1  units  and  II  has  n-k. 


Since  II  plays  his  optimal  strategy,  the  payoff  (I's  probability 
of  survival)  is  v  ^ (k+1 ) .  On  the  other  hand,  I  can  win  in 
two  mutually  exclusive  ways:  he  never  falls  down  to  one  unit, 
or  he  does  but  comes  back  to  win.  The  first  case  occurs  with 


probability  v  (k)  since  I  plays  his  optimal  strategy  in  the 
reduced  game.  The  second  case  occurs  with  probability  1-v  (k)  | 

of  falling  down  to  one  unit,  and  the  probability  v  ^(1)  of 
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then  surviving  (since  II  plays  optimally  in  the  (n+1)  game). 
Hence,  I's  probability  of  survival  is 

v  (k)  +  (l— v  (k)l  v  .(1). 

n  L  n  J  n+1 

thus  , 

(2)  vn+1(k+1)  =  vn(k)  +  [l-vn(kj]  vn+1(1), 

proving  the  lemma. 

Theorem  1 :  For  a  game  of  the  type  (1),  ITs  optimal  strategy 
is  to  "reserve"  one  unit  of  money  and  play  optimally  in  the  re¬ 
duced  game. 

By  induction  then,  if  I  has  k+1  unit  of  money  and  II 
has  n,  I’s  optimal  strategy  is  to  reserve  k  units  of  money 
and  play  optimally  in  the  game  in  which  he  has  1  unit  and  II 
has  n.  Hence,  I’s  optimal  strategy  depends  only  on  the  amount 
of  money  that  II  holds. 

Proof :  Let  I  have  k+1  units  and  let  there  be  n+1  units 

in  the  game.  Suppose  I  plays  his  (unique)  optimal  strategy 
against  any  strategy  of  I I's.  I’s  strategy  and  II 's  strategy 
induce  strategies  for  the  reduced  (n,k)  game.  Let  p  be  the 
probability  of  I  winning  the  reduced  game  (i.e.  of  his  winning 
the  original  game  without  ever  being  reduced  to  one  unit).  Since 
I's  strategy  is  optimal, 

vn+1 (k+1 )  =  p  +  ( 1-p)  vn+1 ( 1 ) . 
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By  (2) ,  p  =  v  (k).  This  is  so  for  every  one  of  II ’ s  strategies. 
Hence,  I's  reduced  strategy  is  optimal  in  the  reduced  game, 
proving  the  theorems. 

with  the  help  of  formula  (4)  of  RM-776,  we  have 


vn+1(Ua)  vn+1 ( 1 +b) 
vn+1(1+a)  +  vn+1(1+b) 


Using  formula  (2)  ,  and  substituting  in  this  equation,  we  obtain 
a  ouadratic  ecuation  for  v  , . (1),  having  onlv  one  positive  root. 
The  solution  is: 


Using  the  trivial 

(4)  v2(1)  =4 


it.  is  possible  to  calculate  v  (k)  in  general  by  induction  on 
n  with  the  he  In  of  (4),  (3),  and  (2).  The  optimal  strategies 
are  then  easily  obtained.  Letting  p  (k)  be  the  probability  of 
I  playing  row  1  in  his  optimal  strategy,  we  have  by  formula  (3) 
of  1-17-776 , 


(5)  pR(1) 


v  ( 1  +  b ) 

n v  ‘ _ _ _ 

v  (1+a)  +  v  (1+b) 
n  n 


v  (1 ) 
n s  ' 

v  (1+a) 

n 


This  is  also  II ’s  probability  of  playing  column  1  in  his  optimal 
strategy  when  I  has  k  units  and  II  has  n-k .  By  theorem  1, 


(1), 


<6>  Pr>1(k+1)  =  pn(k)  =  pn-k+1 

so  that  the  probabilities  p  (1)  give  all  the  optimal  strategies 
which  may  occur. 


mhb 


